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(54) Title: TACTILE FEEDBACK MAN MACHINE INTERFACE DEVICE 
(57) Abstract 

A man-machine interface which provides tactile feedback to 
various sensing body parts is disclosed. The device employs one 
or more vibrotactile units (1801-1805), where each unit comprises 
a mass (20!) and a mass-moving actuator (2(X)), As the mass is 
accelerated by the mass-moving actuator, the entire vibrotactile unit 
vibrates. Thus, the vibrotactile unit transmits a vibratory stimulus 
to the sensing body part to which it is affixed. The vibrotactile 
unit may be used in conjunction with a spatial placement sensing 
device which measures the spatial placement of a measured body 
part (1900). A computing device (1904) uses the spatial placement 
of the measured body part to determine the desired vibratory stimulus 1817- 
to be provided by the vibrotactile unit. In this manner, the computing 
device may control the level of vibrator)' feedback perceived by the 
corresponding sensing body part in response to the motion of the 
measured body part. The sensing body part and the measured body 
part may be separate or the same body pan. 
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TECHNICAL FIELD 

This invention relates to a man-machine interface and in particular to an interface that 
provides tactile sensation to a user. 

BACKGROUND OF THE INVENTION 

Vinual reality (VR) is an immersive environment which is created by a computer and with 
which users have real-time, multisensorial interactions. TypicaUy. these interactions involve 
some or aU of the human senses through either visual feedback, .sound, force and tactile feed- 
back ( i.e. reflection), smell and even taste. The key to immersive realism is the capacity of the 
user to use his/her hand to interactively manipulate virtual objects. Unfortunately, the majority 
of existing commercial virtual reality systems use hand-sensing devices that provide no hapiic 
feedback. Nevenheless. .some efforts have been made to provide means for presenting force and 
tactile informauon to the user's hand. By force information, it is meant the application of a set 
force to a selected part of the hand, for example, a finger. By tactile information, it is meant the 
application of a stimuli, e.g., a vibration, to a selected pan of the hand. e.g.. a fmgenip pad. This 
stimulus, could simulate surface texture or dynamic conditions at the contact, for example. A 
few examples of existing force reflecting devices are the EXOS SAFiRE^^V the Master II Hand 
.Vlaster device at Rutgers university, the PERCRO Forcc-Renocting Hand Master and the 
Sarcos TOPS Force-Reflecting Hand Master. Some tactile feedback devices that have been 
developed include the PERCRO Position-Sensing and Tactile Feedback Hand Master and the 
EXOS TouchMaster™ 

Virtual reality is not the only field where it is desirable to feed back force and tactile infor- 
mation to a human user/operator. Another common area is teleroboiics. Some of the devices 
mentioned above are also often used as lelerobotics interfaces. Some examples in the literature 
of feedback devices designed more specifically for telerobotics include the tactile shape sens- 
ing and display system developed by Kontarinis et al., the voice-coU ba.sed tactile feedback 
device used by Patrick et al. and the pin-ba.sed tactile display array developed by Kaczmarek 
and Bach-y-rita. Other applications for a vibrotactile unit of the subject invention include, but 
are not limited to, gesture recognition, music generation, entertainment and medical applica- 
tions. 
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In an ideal case, it would be desirable to provide full force and tactile feedback lo a user to 
make the virtual reality or telerobotic experience as realistic as possible. Unfortunately, most 
force feedback devices are cumbersome, heavy, expensive and difficult lo put on and remove. 
Many of the tactile feedback solutions are also cumbersome, complex and fragile. Additionally, 
some of the tactile feedback devices described in the literature, such as small voice coils 
mounted to directly contact the skin, tend to numb the skin after only a few seconds of operation 
and then become ineffective as feedback devices. 

SUMMARY OF THE INVENTION 

An object of the invention is a man-machine interface which may be employed in such areas 
as interactive computer applications, lelerobotics, gesture recognition, music generation, enter- 
tainment, medical applications and the like. Another object of the invention is a mass which is 
moved by a "mass-movmg actuator'' which generates a vibration that a user can feel. Yet an- 
other object of the invention is the generation of an activating signal to produce the vibrations 
either as a result of the user's state or as a result of environmental conditions, whether virtual 
or physical. Still another object of the invention is vibrating the bone structure of a sensing body 
pan, as well as skin mechanoreceptors, to provide feedback. Yet still another object of the in- 
vention is the complex actuation of vibratory devices. 

The tactile sensation that a user feels is generated by a vibrotactile unit mounted on, or in 
functional relation lo, a sensing body pan of a user by a fastening means. In one embodiment, 
the vibrotactile device comprises a mass connected eccentrically to a mass-moving actuator 
shaft fi.e. the center of mass of the mass is offset from the axis of rotation ). Energizing the mass- 
moving actuator causes the shaft to turn, which rotates the eccentric mass. Tliis rotating mass 
causes a corresponding rotating force vector. A rapidly rotating force vector feels to the user as 
a vibration. A slowly rotating force vector feels like a series of individual impulses. For a small 
number of rapid rotations, the rotating force vector feels like a single impulse. We will use the 
term ^'vibration" to denote a change in force vector (i.e., direction or magnitude). Hxamples of 
vibrations include, but are not limited to a single impulse, a sinusoidal force magnitude, and 
other functions of the force vector. We use the term 'tactile sensation" to refer to the feeling 
perceived by a user when their sensing body part experiences vibrations induced by a vibrotac- 
tile unit. 

A signal processor interprets a state signal and produces an activating signal to drive the 
mass-moving actuator. The variable components of the state signal may be physical (e.g., mea- 
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sured). or virtual (e.g. simulated, or internally generated); they may vary with time le.g.. the 
.state variables may represent processes): and they may be integer-valued (e.g., binan- or dis- 
crete) or real-valued (e.g.. continuous). Tlie signal processor may or may not comprise a com- 
puter which interprets and further proces.ses the state signal. The signal proces.sor comprises a 
signal driver, which produces an activating signal supplying power to. or controlling the power 
drawn by, the vibrotaciile unit. The power may be. but is not restricted to. electric, pneumatic, 
hydraulic, and combustive types. The driver may be. but is not restricted to. an elccinc motor 
controller comprising a current amp and .sensor for closed loop control, a now valve controlling 
the amount of a pressurized fluid or gas. a now valve controlling the amount of fuel to a com- 
bustion engine and the like. The details of such a signal processor and mass-moving actuator 
are common knowiedge to someone skilled in the art. 

The state signal may be generated in respon.sc to a variety of conditions. In one embodiment, 
one or more .sensors measuring physical conditions of the user and/or the users environment 
may generate one or more components of a physical state signal. In another embodiment, a 
computer simulation may determine the one or more components of a vinuai state signal from 
a simulated (e.g.. virtual) state or condition. The virtual state may optionally be influenced by 
a physical state. The virtual state includes anything that a computer or timing system can gen- 
erate including, but not restricted to. a fi.xed time from a previous event; the position, velocity, 
acceleration (or other dynamic quantity) of one or more virtual objects in a simulation; the col- 
lision of two virtual objects in a simulation; the start or finishing of a computer job or process; 
the setting of a flag by another process or simulation: combinations of .situations: and the Ukc. 
The virtual state signal is a machine-readable measurement of the virtual state variables. 

The physical state signal is measured from physical state variables. These variables have 
relevance to the physical state of a body part of the user or the user's phy.sical environment. The 
physical state variables includes any measurable parameter in the environment or any measur- 
able parameter relating to a body part of the user. Some examples of measurable physical pa- 
rameters in an environment include but are not restricted to. the state of a body part, the position 
of objects in the environment, the amount of energy imparted to an object in the environment, 
the existence of an object or objects in the environment, the chemical state of an object, the tem- 
perature in the environment, and the like. The state of a body part may include the physical po- 
sition, velocity, or acceleration of the body part relative to another body part or relative to a 
point in the environment. The state of a body part may also include any bodily function, where 
the measured state signal may include the output from an electroencephalograph (EEG). elec- 
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trocardiograph fECG). elcctromyograph (EMG). clcciroopiigraph (EOG) or eye-gaze sensor, 
and sensors which measure Joint angle, heart rate, dermal or subdcrmal 'temperature, blood 
pressure, blood oxygen content (or any measurable blood chemical), digestive action, stress 
level, voice activation or voice recognition, and the like. The user's voice may constitute a mea- 
sured physical state variable, where his spoken words are sensed and/or recognized to generate 
a corresponding activating signal. The physical state signal is a machine-readable measure- 
ment of the physical state variables. 

The state signal is presented to the signal processor which interprets the state, and then de- 
termines how and when to activate the vibrotactile units accordingly. The signal processor pro- 
duces an activating signal which may be in response to an event it interprets from the state 
signal. Examples of events include contact, gestures, spoken words, onset of panic or uncon- 
sciousness, and the like. The interpretation of the state signal may or may not be a binary event, 
i.e. the simple changing of state between two values. An example of a binary event is contact 
vs. non-contact between two virtual or real objects. The process of interpreting may include 
any general function of slate variable components. The interpretation function may produce an 
output conu^ol value which is integer or real- valued. A non-binary-valued interpretation output 
typically relates to the signal processor producing a non-binary activation signal. 

By varying the functional form of the activation signal, the type of feedback that the vibro- 
tactile device generates may also be varied. The device may generate a complex tactile sensa- 
tion, which is defined to be a non-binary signal from a single or multiple vibrotactile units. 
Examples of complex tactile sensations include ( h varying the amplitude of vibration with a 
profile which is non-uniform over time; (2) varying the frequency of vibration; (3) varying the 
duration of impulses; (4) varying the combination of amplitude and frequency; (5) vibrating 
two or more vibrotactile units with a uniform or non-uniform amplitude profile; (6) sequencing 
multiple vibrotactile uniLS with different amplitude or frequency profiles; and the like. 

The frequency and amplitude of the vibration or impulse may be changed by modifying the 
activating signal to the mass-moving actuator. The frequency and amplitude may also be con- 
trolled by increasing the mass or by changing the radms of gyration (e.g. changing its eccen- 
tricity). For example, the mass may be changed by pumping lluid into an eccentrically rotating 
container. The sense of frequency that the user perceives may be changed independently of the 
amplitude by modulating the power to the vibrotactile unit at a variable frequency. This tech- 
nique is called amplitude modulation, which is common knowledge to those skilled in the art. 
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This change m frequency and ampliiude may be used to convey complex, compound or other 
forms of informaiion to the user. 

Sensors may be mounted on the vibrotactile unit or the sensing body part to determine the 
frequency and amplitude of vibration sensed by the user. A feedback control loop may be added 
which uses this information to more tightly control the frequency and amplitude, or to reach 
peak efficiency at the resonant frequency of the collective vibrating device-body system. 

Examples of a sensing body part on which the vibrotactile unit may be mounted, or in func- 
tional relation to the vibrotactile unit, include, but are not limited to: the distal part of a digit, 
the dorsal (back) side of a phalanx or metacarpus, palm, forearm, humerus, underarm, shoulder, 
back, chest, nipples, abdomen, head. nose. chin, groin, genitals, thigh, calf. shin. foot. toes, and 
the like. A plurality of vibrotaculc units may be disposed on or near different sensing body 
part5, and may be activated in unison or independently. 

Each vibrotactile unit may be affixed to the body by a fastening means. The fastening means 
is defined to be the means of attaching the vibrotactUe unU to a sensing body part, transmitting 
(and possibly modifying) the vibrations created by the vibrotactile unit. This means may be one 
that is nexible such as a strap made of cloth or soft polymer, or rigid, such as metal or hard poly- 
mer which grabs or pinches the fiesh, skin or hair. The fastening means may also include glumg 
or taping to the skin or hair, or tying with a stnng or rope around a limb, or attaching to clothes 
with Velcro* or similarly functional means. A vibrotactile unit may al.so be attached to another 
structure which is then attached to the body pan with the same means just mentioned. The vi- 
brations generated by the actuator may be transmitted to the sensing body pan by the structure 
(rigid or non-rigid), or through a linkage transmission or a fiuid transmission. 

The eccentric mass need not be mounted directly onto a motor shalt. A mechanical transmis- 
sion may rotate the mass on a different shaft than the motor shaft. The mass-moving actuator 
rotates this shaft. Fluids such as air and liquids may also transmit the motion from a power 
source to the rotaung eccentric mass. Changing magnetic fields may al.so be employed to in- 
duce vibration of a ferrous mass. 

AS previously mentioned, state signals may relate to a physical or virtual state. When the 
state represents a physical condition, the subject invention includes a state measurement sensor 
which produces a state signal. This state measurement sensor may measure some propeny ot 
the sensing body part. RecaU that the body pan associated with receiving the vibrotactile stim- 
ulation is called the sensing bod. pan, the body pan associated with producing the activating 
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signal is called the measured body part. The signal processor may receive signals from this sen- 
sor such as a tactile, position, bend, velocity, acceleration or temperature sensor and generate 
an activating signal. In this way, the user may receive feedback based on his actions or physical 
state. For example, the vibrotactile device may be used to train the user to do some physical 
motion task. In this case, the position or motion of the body part which is to do the motion task 
is measured by the state measurement sensor and is also the sensing body part. Direct stimula- 
tion to the body pan being trained enhances the training of the task. Complex actuation in the 
form of a function of different levels of frequency or amplitude may inform the user whether 
his actions are correct or incorrect: the level of correctness may correspond to the level of fre- 
quency or amplitude. 

In addition, the sensing body part (which is also the measured body part) may have a graph- 
ical representation shown to the user. The user may also be presented with visual, auditory, 
taste, smell, force and/or temperature cues to his actions in combination with the vibrotactile 
cues provided by the subject invention. The user may be immersed in a vinual environment. 
The user may see a graphical representation of his/her body part interact with virtual objects 
and simultaneously feel a corresponding tactile sensation simulating the interaction. For exam- 
ple a user may have his/her fingers be the sensing and measured body parts. The user may then 
see his/her virtual hand in the virtual environment contact a vinual object. The user would then 
feel an increasing vibratory stimulation on his/her physical fingertip as he increased the vinual 
pressure on the virtual object using the virtual fingertip. 

As previously discussed, using the vibrotactile device of the subject invention, a user may 
receive tactile sensations based on the state of his body parLs. In the previous case the state in- 
cluded the position, and other dynamic quantities, of the body parts. In certain applications, the 
measured body part is the same as the sensing body part (the list of possible sensing body pans 
mentioned earlier also applies to measured body parts): in other applications they arc different 
body parts. When the measured body pan is different than the sensing body pan, the subject 
invention acts as a coupling device which relates the sensing body pan and the measured body 
part. 

In another application, the user may receive tactile feedback as a result of the conditions of 
a computer simulated environment, not necessarily related to the user's actions or state. The vi- 
brotactile units with varying actuation levels may be used to simulate a variety of contact situ- 
ations, e.g., contact with fluids and solids, and contacts which are momentary or continuous. 
For example, a user immersed in a computer simulated vinual environment may feel simulated 
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nuid (like air or water) across his body. In such a simulation, an array of vibrotaci.le unii^ may 
vibrate in sequence to correspond to a pressure wave hitting the corresponding parts of the 
body: the amplitude of the vibration may var>' to correspond to different levels of pressure be- 
ing simulated. A user may also feel a virtual objccl that comes into contact with a portion of his 
virtual body. The user may feel a virtual bug crawl up his virtual arm by sequencing an array 
of vibroiactile units. To accompany the tacule sensations received by ihe user which are uncor- 
rected with his actions, the user may be presented with visual, auditory, taste, smell, force, tem- 
perature and other forms of feedback in order to enhance the realism of the simulated 
environment. 

In yet another appUcaiion of the vibrotactile device, a group of users may receive tactile sen- 
sations. In one example, users may wear individual vibrotactile units, or they may also share 
vibroutctile units as follows. A tactile sensation may be shared by one or more users making 
physical contact with the sensing body part of another user. For example, one user may wear 
vibrotactile units on the backs of his fingers. A .second user, not wearing any vibrotactile units, 
may obtain vibrotactile feedback transmitted via the first user when the first u.ser places the pal- 
mar side of his nngers on a sensing body part of the second user. The activating signal for each 
vibrotactile unit may be computer controUed via either user's actions or through a computer 
simulated event. In a second example, a group of users may each receive identical tactile feed- 
back through individually mounted vibroiactile units. TTie common activating signal may cor- 
. respond to measured body parts from a single, optionally separate, user. Different users may 
also be responsible for producing the common activating signal for one or more vibroiactile 
units. For instance, the movement of one user's arm may control the vibrotactile unit on each 
user's arm: and the voice of a second user may conu-ol the vibrotactile unit on each user's back: 
the eye-gaze of three other u.sers may control the vibrotactile unit upon which they siare in uni- 
son. An example application of a single user controlling many user's vibrotactile sen.sations is 
a new form of enienainment where a perfomier creates vibrotactile sensations for an audience. 

In a preferred embodiment, the vibrotactile units arc alTixed to an instrumented glove, such 
as the C^■beK}\o^^c^^ manufactured by Virtual Technologies of Palo Alto. CA. USA. The Cy- 
&.rGlove has sensors in it which measure the angles of the joints of the hand. The fingertips of 
the CyherQlo^e are open so that the user may reliably handle physical objects while wearing 
the glove. The open fingertips allow the user to feel the sensations of real objects in conjunction 
with the generated vibrotactile sensations. The fingcitips need not be open, they amy be fully 
enclosed as in the 22-.sensor model of the Cyher<j\ovo. The mass-moving actuator of each vi- 
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brotaciile unii is encased in a cylindrical housing and mounted onto the glove on each of the 
fingers and thumb, and on the palmar side of the hand. Each mass-moving actuator is composed 
of a small DC motor with an eccentric mass mounted rigidly onto the shaft of the motor. The 
casing is made of tubular plastic and serves to protect the motion of the mass from the user and 
protect the user from the rotating mass. The casing may be made of any rigid or semi-rigid ma- 
terial including but not limited to steel, aluminum, brass, copper, plastic, rubber, wood, com- 
posite, fiberglass, glass, cardboard, and the like. The casing may form a solid barrier, a wire- 
mesh, grid or column-like support capable of transmitting vibrations from the mass-moving ac- 
tuator to the fastening means. The instrumented glove informs a computer of the position of the 
user's hand and lingers. The computer, which is part of the signal processor, then interprets this 
hand state signal (and any virtual state signal if the application calls for it). The computer then 
generates a control signal, which when processed by the driver, activates the actuators to create 
tactile sensations. 

One feamre of the embodiment of the subject invention just described, which employs an 
eccentric mass, is that the energy impaned into the system can be less than the energy required 
when using electromagnetic coils (such as the speaker voice coils used by Patrick et al. and the 
EXOS TouchMaster). Energy is stored as rotational inertia in die eccentric mass, whereas the 
voice-coil-based systems lose aJl inertial energy each time the coil change directions. 

Another feature of the subject invention is that vibrating the bone structure of a body part, 
as well as skin mechanoreccptors, has an advantage over stimulating just the skin mechanore- 
ceptors (such as Meissner. Merkel. Ruffini and Pacinian corpuscles) in that the nerves do not 
get easily oversumulated and do not become numb. In addition, the form of information to the 
user is closer to a physical contact sensation where the muscles and joints are stimulated, as is 
done by full force feedback systems. As a result, the vibrotactile uniLS need not be attached to 
a body part which has sensitive skin mechanoreccptors. For example, a vibrotactile unit may be 
attached to a fingernail or an elbow. 

In an embodiment in which a user is immersed in a computer simulated environment, actu- 
ation of vibrotactile units can approximate the sensation of touching physical objects as full 
force feedback devices do. The deep impulsive sensation in the muscles and joints generated 
by the vibrotactile units simulates the change in proprioceptive state as the user touches a vir- 
tual object. The subject invention provides numerous advantages over a sustained force feed- 
back device. For example, because of iLs simplicity, the vibrotactile device of the subject 
invention can be made smaller, lighter, less encumbering, more robustly and cheaper. 
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The subject invention may be used in combination with a sustained force feedback device 
as provided by Kramer in US Patent #5. 1 843 i 9. Kramer in US Patent Application #08/373,53 1 
(allowed). Zamdiansky in US Patent #4.302. 1 38. Burdea in US Patent #5.354. 162. and Jacobus 
in US Patent #5.389.865. These patents and patent applications are incorporated herein by ref- 
erence. Such a combinauon can give a higher frequency response than that capable of being 
generated by the sustained force feedback device and/or to reduce the cost and/or size of the 
full system. The subject invention may also be used in combination w.th other tactile feedback 
devices such as heating or cooUng devices, bladder devices or voice coils. 

BRIEF DESCRIPTION OF THE DRAWINGS 

. FIG. la is a perspective view of an electric mass-moving actuator with an eccentric mass 
attached to its shaft. 

. FIG. lb is a perspective view of a mass-movmg linear actuator with a mass attached to its 
shaft. 

. FIGS. 2a and 2b are a cross-sectional side view and a perspective view respectively of an 

example of a vibroiaciile unit. 
. FIG. 3 is a perspective view of the vibrotactile unit shown in FIG. 2b where die vibrotactile 

unit is atuched to the palmar side of the fingertip. 
. FIG. 4 is another perspective view of a vibrotactile unit attached to the dorsal side of the 

fingenip. where it makes contact with the nail. 
. FIG. 5 is a perspective view of a vibrotactile unit attached to the dorsal side of the proximal 

phalanx. 

• FIG. 6 is a perspective view of a vibrotactile unit attached to the palm of the hand 

. FIG. 7 is a perspective view of a vibrotactile una attached to the dorsal side of the metac- 
arpus (the back of the hand). 

. FIG. 8 is a perspective view of a vibrotacule unit attached to the top of the foot. 

. FIG. 9 is a side view of a multitude of vibrotactile units attached to a variety of places on the 
head. 

. FIGS. 10a and 10b are front and back views respectively, of a multitude of vibrotactile units 
attached to a variety of places on the body. 
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• FIGS. I la and 1 lb are perspective and front views respectively of a fastening means where 
the paJmar side of the lingenip receives greater stimulation without ihe vibrotactile unit 
getting in the way of manipulation. 

• FIGS. I2a and 12b are perspective and front views respectively of a fastening means where 
the . palmar side of the fingertip receives greater stimulation without the vibrotactile unit 
getting in the way of manipulation. 

• FIG. 13 is a perspective view of a fastening means where no casing is required for the vibro- 
tactile unit because the moving mass is mounted away from the finger thus reducing the 
possibility of interference. 

• FIG. 14 is a side view of an another fastening means where no casing is required for the 
vibrotactile unit because the moving mass is mounted away from the finger thus reducing 
the possibility of interference. 

• RG. 15 is a perspective view of a fastening means where the vibrotactile unit is attached to 
the body via a spring that is used to alter the amplitude and frequency of the sensed oscilla- 
tions. 

• RGS. 16a, 16b and 1 6c are front schematic views and 16d is a perspective view of a vibro- 
tactile unit where the radius of the gyration of the eccentric mass increases as the angular 
velocity of the shaft increases. FIGS. 16a, 16b. and 16c illustrate the principle, where W2 > 
wj> 0. 

FIG. 17 is a schematic electrical-mechanical signal propagation diagram. 

FIGS. 18a and 18b show an instrumented glove, in this case the Virtual Technologies Cvber- 
Glove™, with both position sensors and vibrotactile units. 

FIG. 19a and 19b show schematically two applications using a .sensing glove with vibrotac- 
tile units attached to the fingers and back of the hand. FIG. 19a .shows a virtual reality appli- 
cation. FIG. 19b shows a telerobotic application. 

FIG. 20 illustrates schematically an example of a virtual environment with separate sensing 
and measured body parts. 

FIG. 21a and 21b are perspective drawings showing two applications of the invention for 
gesture recognition. In FIG 2 1 a, the gesture is static and in FIG. 21b. the gesture is dynamic 
(the index finger is moving in a pre-determined fashion). 
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FIG. 22 is a .schematic drawing showing a musical application.- 

FIG. 23 is a schematic drawing showing an entertainment or relaxation application. 

FIG. 24 is a schematic drawing showing a medical appUcation. 

FIG. 25a. 25b and 25c are a schematic drawings illustrating an amplitude decoupling 

method. 

. FIG 26a is a perspective drawing and FIG. 26b is a side view of a vibrotactile unit with a 
controllable eccentricit>'. FIG. 26c is an alternative transmission method that can be used to 
control the eccentricity of the mass. 

. FIG. 27 is an exemplary diagrammatic view of an application comprising the vibrotacule 
device, a virtual simulation and a physical simulation. 

DETAILED DESCRIPTION OF THE DRAWINGS 

FIG la Shows one embodiment of a vibrotactile unit obtained by attaching an eccentric 
mass (101) to the shaft (102) of a small d.c. electric motor (100) which ser^'es as the mass- 
movina actuator. Here the mass is pie-shaped, however any other shape which offsets the center 
of gravity from the axis of rotation, and thus provides eccentricity, may be u.sed. This eccen- 
tricity causes the force vector to change direcuons during rotation and thus induces vibrations 
in the unit. The mass may be made of any material like steel, aluminium, plastic or nuid encased 
in a container, to name a few. 

FIG lb .shows another embodimem of a vibrotactile unit obtained by attaching a mass (103) 
to the shaft (104) of a linear mass-moving actuator (105). Here the mass is disk-shaped, 
however any other shape may be used. The linear actuator moves the mass back and torth and 
thus induces vibrations in the unit by suddenly accelerating and decelerating it. The ma.ss may 
be made of any material like steel, aluminium, plastic or tluid encased in a container, to name 
a few. 

FIG ''a and FIG. 2b are cross-sectional and perspective drawings respectively of an exam- 
ple of a casine (200) in which a mass-moving actuator (202) and a mass (201) are contained. 
Again the eccentric mass (201) is attached to the shaft (204) of the electric motor. The casing 
has a hole for the motor leads (203) to escape. The casing protects the moving mass trom bemg 
disturbed by the user. It also protecLs the user from being hit by the mass. The casing may be 
made from anv rieid material, or variety of materials, such as aluminum, steel, plastic, glass. 
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glass fiber composite etc. It is typically desirable to have a small light weight mass-moving 
actuator, mass, casing and fastening means so that the device may be as unencumbcring as 
possible. From here on. this embodiment of the invention will serve as the sample vibrotactile 
unit used in many of the subsequent figures. 

FIG. 3 illustrates one fastening means for attaching the vibrotactile unit to a finger. In this 
example, the vibrotactile unit (300) is attached directly to the palmar side of the fingertip using 
a fastening means (301). The fastening means may be made of either flexible material, such as 
cloth, fabric, tape, Velcro® or a soft polymer, or it may be made of a rigid material such as a 
metal, hard polymer or wood, to name a few. The fastening means need not encircle the finger 
entirely, it may grab the finger by clamping or pinching, or by sticking to it such as with glue 
or tape. Also, if the user is wearing a glove, the vibrotactile unit may also be sewn onto the 
glove or bonded to it and need not be affixed directly to the hand. This will also be the case in 
the following figures which illustrate various ways to position the vibrotactile unit on the 
human body. 

FIG. 4 illustrates another way of mounting the vibrotactile unit (400) onto the finger using 
a fastening means (401). In this case the unit is positioned directly above the fingernail on the 
dorsal side of the fingertip (the sensing body part) in order to provide a distinctive tactile sensar 
tion, or vibratory stimulus. The unit may vibrate the nail, the flesh underneath and the bone with 
sufficient amplitude that the sensation is felt throughout the finger, not just locally at the skin, 

FIG. 5 illustrates another way of mounting the vibrotactile unit (500) onto the finger using 
a fastening means (501). In this case the unit is positioned on the dorsal side of the proximal 
phalanx. Since the unit gives sensation throughout the entire finger, touching virtual objects 
with the palmar side of the hand will still give sensations to that side even though it is mounted 
on the back. When used in conjunction with manipulating physical objects with the palmar side, 
the vibrational sensation on the palmar side is enhanced. These features are not limited to the 
proximal phalanx. Mounting to the dorsal side of any phalanx or limb will produce the same 
effect. 

FIG. 6 illustrates another way of mounting the vibrotactile unit (600) onto the user using a 
fastening means (601). In this case the unit is positioned in the palm of the user's hand. If a 
glove (instrumented or not) is worn, then the unit may also be mounted inside or outside of the 
glove in a pocket-like cavity, and need not be explicitly affixed to the hand. 
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no. 7 illustrates another way oi mounting the vibrotactile unit (700) onto the user using a 
fastening means (701). In this case the unit is positioned on the dorsal side of the metacarpus, 
or the back of the hand. Again, if a glove (instrumented or not) is worn, then the unit may also 
be mounted inside or outside of the glove in a pocket- like cavity, and need not be explicitly 
affixed to the hand. 

FIG. 8 illustrates another way of mounting the vibrotactile unit (800) onto the user using a 
fastening means (801). In this case the unit is positioned on the top of the user's foot. If a sock- 
like garment (instrumented or not) is worn, then the unit may also be mounted inside or outside 
of the garment in a pocket-like cavity, and need not be explicitly affixed to the foot. 

FIGS. 9 illusu-ates another way of mounting vibrotactile units (900) onto the user. In this 
example, the units are positioned on the user's head. If a hat-like garment (instrumented or not) 
is worn, then the units may also be mounted inside or outside of the suit in pocket-like cavities, 
and need not be explicitly affixed to the body. Examples of locations include, but are not limited 
to, the temples (900). the forehead (901). the top of the head (902) and the back of the head 
(903). 

FIG. 10a illusu-ates another way of fastening vibrotactile units (1000-1012) onto the user. In 
these examples the units are positioned all over the front and the side of the user's body. If a 
body suit (instrumented or not) is worn, then the units may also be mounted inside or outside 
of the suit in pocket-like cavities, and need not be explicitly affixed to the body. By actuating 
a combination of actuators, the perception of the localization of the tactile .sensation may be 
controlled. For example, if the actuators on the forearm ( 1007) and on the humerus (1005) actu- 
ate with equal intensity, the user may have the perception that there is a single source of sensa- 
tion originating in-between the two. This may apply to any combination of vibrotactile units 
located anywhere on the body. This effect is also apparent when multiple vibrotactile units are 
activated in sequence. There is a pcrcepuon that a single vibration has "moved" between the 
activating vibrotactile units. The vibrotactile units displayed in the figure show examples of a 
variety of candidate posiuons for atuching the units. Some of these positions include, but are 
not limited to. the forehead (1000). the shoulders (1001). the side of the arm (1003). the 
humerus (1005). the chest (1002). the nipples (1004), the abdomen (1006). the forearm (1007). 
the groin (1008). the hips (1009). the thighs (1010). the knees (101 1) and the shins (1012). 

HG. 10b iUusirates another way of fastening vibrotactile units (1020 - 1028) onto the user. 
In these examples the vibrotactile units are positioned all over the back of the user's body. If a 
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body suit (insirumenied or not) is worn, then the vibroiaciilc units may also be mounted inside 
or outside ihe body suit in pocket-like cavities, and need not be explicitly aiYiAed to the body. 
The vibrotactiie units displayed in the figure show examples of a variety of candidate positions 
for attaching the units to the body. Some of these positions include.. but are not limited to. the 
back of the head (1020). the base of the neck (1021), between the shoulder blades (1022). the 
back of the humerus ( 1023), the back of the forearm ( 1 025). the lower back ( 1 024\ the buttocks 
(1026). the back of the thighs (1027) and the calves (1028). The vibrotactiie units in FIG. 10b 
may be combined with those in FIG. 10a as well. This plurality of vibrotactiie units shows one 
way that complex tactile sensations may be generated with multiple vibrotactiie units. 

FIGS. 1 la and 1 lb show a vibrotactiie unit mounted in such a way that the fingenip may be 
stimulated without the unit getting in the way of manipulation with the fingers. FIG. 1 la shows 
a perspective view of the invention and FIG lib shows a frontal view. A structure (1 102), which 
may be opened or closed at the end, surrounds the fingenip. The fastening means is comprised 
of three parts: pan one affixing the finger to the structure; part two affixing the vibrotactiie unit 
to the structure: part three is the structure (1 102). Part one of the fastening means (1 1 03), which 
can be a flexible or rigid membrane, holds the finger against the structure on the palmar side of 
the fingertip. This part can be adjustable, fixed, flexible or stretchable. In pan two, the vibro- 
tactiie unit (1 100) is mounted atop the structure, away from the palmar side of the fingertip, 
using a means (1101) which can be a flexible or rigid membrane. In this manner, the vibrations 
from the vibrotactiie unit may be transmitted through the structure directly to the palmar side 
of the finger to provide a greater stimulation of the nerves local to the palmar side. In another 
embodiment, the structure (1 102) and the vibrotactiie unit casing (1 100) can be made of one 
part, thus eliminating the need for a pan two of the fastening means f 1 101). 

FIGS. 1 2a and 1 2b show the vibrotactiie unit mounted such that the fingertip can be stimu- 
lated without the unit getting in the way of manipulation with the fingers. FIG. 12a shows a 
perspective view of the invention and FIG. 1 2b shows a side view. A structure (1202) is 
attached to the palmar side of the fingertip. The fastening means is comprised of three parts: 
part one, affixing the finger to the structure; part two, affixing the vibrotacule unit to the struc- 
ture; part three which is the structure (1202). Part one (1203) may be a flexible or rigid 
membrane. This part may be adjustable, fixed, flexible or stretchable. In pan two. the vibrotac- 
tiie unit (1200) is mounted atop the structure, away from the palmar side of the fingenip. using 
a means (1201) which can be a flexible or rigid membrane. In another embodiment, the 
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Structure (1202) and the vibrotactile unit casing 1 1200) can be ntiade of one pan. thus eliminat- 
ing the need for part two of the fastening means (1201). 

FIG. 13 shows a vibrotactile unit and fastening means where no casing is required for the 
mass-moving actuator/mass assembly. A small rigid or semi-rigid structure ( 1 302) elevates the 
vibrotactile unit above the fingertip in such a way that the linger cannot interfere with the rota- 
lion of the eccentric mass (1301) about the main axis of the shaft (1304) of the mass-moving 
motor (1300). The structure (1302) is attached lo the fingertip using a strap (1303) which can 
be rigid or flexible and which can be either an integral or separate part of the structure. 

FIG. 14 shows another vibrotactile unit and fa.sicning means where no casing is required for 
the mass-moving actuator/mass assembly. A small rigid or semi-rigid structure (1404) elevates 
the vibrotactile unit above the middle phalanx in such a way that the finger cannot interfere with 
the rotation of the eccentric mass ( 1402) about ihe main axis of the shal't (1403) of the mass- 
moving actuator (1401). The structure (1404) is attached to the middle phalanx using a 
strap (1405) which can be rigid or flexible and which can be either an integral or separate part 
of the structure. 

RG. 15 shows yet another vibrotactile unit (1500) and fastening means such that the vibro- 
tactile unit is connected to the fingertip via a form of spring (1501) in order to alter the ampli- 
tude and frequency of the perceived vibrations. A strap (1502) which can be a flexible or rigid 
membrane holds the .spring against the fingertip. The spring changes the natural frequency of 
the vibrotactile unit. Alternatively, the vibrotactile unii/spring apparatus could be attached 
below the finger instead of above it. The spring may also be replaced by some form of actuator 
to again control the amplitude and frequency and/or to extend the range of amplitude and 
frequency. In addition a damper may be introduced in combinauon with the spring or actuation 
system to further control and/or extend the amplitude and frequency of the perceived vibrations. 
An eleciro-rheological fluid may used in the damper lo control the damping term in the 
mechanical system. 

HGS. 16a. 16b. 16c, and 16d illustrate a modification to the way the eccentric mass is 
mounted to a shaft. The radius of the gyration A' of the eccentric mass increases as the angular 
velocity of the shaft increases. The top three drawing.s (RGS. 16a. 16b. 16c) iUustrate the prin- 
ciple, where w, > wi> 0. and the bottom perspective drawing (FIG. 16d) provides an imple- 
mentation. In FIG. 16d. a structure ( 1601 ) is attached the shaft (1602) of the mass-moving actu- 
ator (1600). The structure comprises a spring (1604) and mass (1603) assembly. At one end. 
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[he spring is attached to the inside of the structure and at the other end it is attached to the mass. 
The mass is free to move towards and away from the shaft inside a guide in the structure. The 
radius of gyration K is \ht distance between the center of gravity of the mass (1603) and the 
main axis of the mass-moving actuator shaft (1602). As the angular velocity of the shal*t 
increases, the centrifugal forces felt by the mass increase, causing it to stretch the spring further 
and increase the radius of gyration. This apparatus minimizes the angular inertia of the device 
at stan-up and then gradually increases the eccentricity of the mass so that larger vibrations can 
be obtained at higher angular velocities. This relieves the sms^ on the bearings that hold the 
shaft and reduces the larger initial torque required to initiate rotation fas opposed to the torque 
required to maintain rotation). Alternatively, the passive spring may be replaced by an active 
device which controls or seLs the radius of gyration of the mass. The active device may 
comprise a shape memory alloy actuator or any other mechanism capable of controlling the 
position of the mass. 

FIG. 17 shows how the electrical and mechanical signals propagate through the tactile feed- 
back control system in a preferred embodiment of the invention. The embodiment shown 
employs a d.c. servo motor (1701) as the mass-moving actuator of a vibrotactile unit. A 
computer (1707), or other signal processing means, sends a digital value representing the 
desired actuation level control signal to the digital-to-analog conven, D/A (1703). The analog 
output of the D/A is then amplified by a variable gain amplifier (1704) to produce an analog 
voltage activation signal. This voltage is placed across the servo motor, driving the motor at a 
desired angular velocity. The voltage signal may alternately be convened to a current activation 
signal for driving the motor at a desired torque. Velocity damping of the servo control loop 
may be performed by tachometer feedback (not shown). The computer (1707). digital-to- 
analog convener (1703), analog- to-digital convener, A/D (1702), bus (1709) and variable gain 
amplifier (1704) may be elements of a signal processor. Digitized values from A/D (1702) from 
analog joint angle sensors (1705) provide the position information of the fingers (measured 
body parts) to the computer as a physical state signal. In a virtual environment application, the 
physical state signal may cause motion in a corresponding vinual hand. If one of the digiLS of 
the virtual hand is found to be intersecting a virtual object, the computer calculates the viaual 
force to be applied to the virtual digit using knowledge of the virtual object's shape and compli- 
ance. The computer then causes an activation signal to be sent to the vibrotactile units mounted 
on the user's fingers (sensing body part) to convey tactile infonmation about that virtual force. 
Strain gage, fiber optic, potentiometric. or other angle sensors may be used as analog joint angle 
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sensors (1705). Strain gage ancle sensors arc disclosed in the Kramer ct al. US Patent Nos. 
#5.047.952 and #5.280.265. which patents arc incorporated herein by reference. 

I'lG. 18a and FIG. 18b illustrate a preferred embodiment of the invention. An insir^imented 
glove (1820) such as the CvbeK;iove^^ manufactured by Virtual Technologies of Palo Alto 
CA. USA. has sensors (1 807- 1 8 1 9) on it which measure the angles of the joints of the hand (the 
measured body parts). In the figures, the fingertips of the glove are open so that the u.ser may 
handle physical objects while using the glove. This allows the user to feel the tactile sensations 
of real objects which may then be used in conjunction with tactile sensations generated from 
the subject invention. TTie vibrotactile units (1801-1806) arc encased in cylindrical housings 
and fastened to the glove on each of the fingers (1801-1804). the thumb (1805) and on the 
palmar (1806) side of the hand. The vibrotactile uniLS are composed of a d. c. motor (item 202 
in FIG. 2) with an eccentric mass (item 201in FIG. 2) mounted onto its shaft (item 204 in FIG. 
2). The casing is made of tubular plastic and ser^•es to protect the motion of the mass from the 
user and protect the user from the rotaung mass. 

HG. I9a shows a user wearing a sensing glove (1900) which can measure hand formauons 
as well as the spatial placement of the hand. The sensing glove has vibrotactile units (1901) 
fastened to the fingers and to the back of the hand. The user receives visual feedback through 
a graphical representation of his hand on the computer monitor (1908). The computer (1904) 
receives the state signal (information about the spatial placement of the user's hand) through 
the sensors mounted on the glove via a glove .sensor interface (1902). When the vinual graph- 
ical hand (1906) touches (1907) a virtual object ( 1905) on the monitor, the computer sends a 
control signal to the vibrotactile unit driver (1903) which then sends the activation signal to the 
vibrotactile units (1901). 

In a simUar setup. FIG. 19b shows the same glove (1900) and computer interface remotely 
conirolliiig a robodc arm (191 1) instead of a graphic display. The robot has contact sensors on 
its giipper (1912) that detect when the robot touches physical objects (1913). The user conu-oKs 
the robot arm through the sensors on the glove which produce position readings of die fingers 
(measured body pans) which are sent to the glove interface device (1902) and then outputted 
to the computer (1904) which in turn sends the appropriate commands to die robot. Robot posi- 
tion and contact information (1910) is then fed back to the computer as the state signal. The 
computer interpreus this signal and decides what kind of vibrational feedback should be sent to 
the vibrotactile unit (1901) (other vibrotaciUe uniis not shown) on the user via the vibrotacule 
unit driver ( 1903). Force or pressure sensors may be mounted on the gripper instead of contact 
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sensors. The user then receives vibrational feedback of varv'ing levels depending on the force 
or pressure on the object. This aliows a teieopcraior lo perform tasks more efficiently and 
safely, especially in handling delicate objects that would break under certain grip forces. The 
user does not necessarily need to control the robot or the objects of contact in order to use the 
tactile feedback. The vibrotactile device may act simply to inform the user of contact with the 
object whether or not as a result of the user's actions. 

FIG. 20 illustrates an embodiment in a virtual reality context where the measured body part 

(2003) is the foot, however, the vibrotactile unit (2001) is mounted on the finger which acts as 
the sensing body part (2002). The foot has a graphical object (2004) associated with it in the 
computer simulation. In this case, the graphical object looks like a foot as well. Motions of the 
foot are sent to the computer (2008) via the body sensor interface (2006) and are reflected on 
the computer monitor (2009). When the computer (2008) determines that the graphical foot 

(2004) contacts a virtual object (2010), ilic computer interprets this state signal and sends a 
control signal to the vibrotactile unit driver (2007) to activate the vibrotactile unit (2001) on the 
finger. This may be due to the user moving his foot so that the graphical foot contacts (2005) 
the vinual object, or the virtual object moving into the graphical foot independent of the user's 
actions. The user then needs to correlate the contact of the virtual object with the sensation at 
the fingertip. While this does not seem as natural as vibrating the foot as it makes contact, this 
illustrates the sensing body part separate from the measured body part. This is necessary if the 
measuring body part cannot coincide with the sensing body part, for example if the measured 
body paa is the eye-ball or if the measured body part is on another user. 

FIG. 2 la and FIG. 21b illusuate a glove (2101) which contains both position sensors and 
vibrotactile units (2100). The Virtual Technologies C\7^t7Glovc™ is an example of a glove 
with appropriate position sensors. The sensors measure the spacial placement of the hand and 
fingers. A computer uses gesture recognition software to determine if a pre-specitled hand 
formation or motion has been gesticulated. In FIG. 21a. the vibrotactile unit signals the user that 
a particular static pose has been detected. A different vibrotactile sensation can be generated in 
response to a recognized moving hand or arm gesture that includes dynamic motions (FIG. 
21b). TTiis may also be useful in training the gesture recognition software for the gestures to be 
recognized. In training the software, a user must repeatedly make the same gesture to obtain 
some son of average position since humans cannot repeat gestures exactly. With the vibrotac- 
tile feedback, the user may be trained to better repeat his gestures while at the same time train- 
ing the recognition software to recognize his gestures. Better repetition of the gestures reduces 
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ihe stausticaJ distribution of the sensor readings tor a given hand gesture wh.ch m turn may 
improve the performance of the recognition system. 

FIG. 22 illustrates vibrotactile units in a musical application. The units are attached to a body 
suit or mounted direcUy onto the user's clothmg. Different regions on the body (2200-2210). 
which contain groupings of vibrotactile umts (2211). may correspond to different musical 
instruments in an orchestra and serve to enhance the musical experience. For example, music 
produced by a cello produces proporuonal vibrations on the user's thigh (2204) through the 
vibrotactile units located in that body region. Similarly, the drums induce vibrations in the units 
that stimulate the chest area (2201) and so on. Sections of the body containing multiple vibro- 
tactile units corresponding to one instrument type may have individual vibrotactile units corre- 
sponding to individual instruments. For example, the ceUo sect.on of the body us shown to have 
the first chair ceUo on the upper thigh, and the second chair cello on the lower thigh. The user 
may either be a passive listener -'feeling" the instruments as well, or he may be an active partic- 
ipant in creating the music, receiving the vibrotactile sensations as feedback. 

HG. 23 illusu-ates an entertainment application. In this case an array of vibrotactile units 
simulates water flow or wind. In this illustration a user is lying on a couch (2300) and is 
immersed in a virtual beach scene and sees the beach through a head-mounted display (2302). 
The user hears ocean sounds through head-mounted earphones (2301) and feels wamtth from 
the sun through heat lamps (2303). The u.ser then feels wind simulated by the vibrotactile units 
as thev arc pulsed in sequence creating -waves" of sensation. For example, the wind could flow 
from head to toes bv alternatively pulsing the vibrotactile units starting with the ones on the 
head (2304) and ending with the ones on the toes (2305). Similarly, water is felt as pulsed waves 
(although perhaps of larger amplitude), as the user swims through the virtual water. In this fash- 
ion, the user may be relaxed or entertained. 

FIG 24a and FIG. 24b illustrate a medical application where, for example, a user has injured 
a knee A vibrotactile unit (2401) is used in conjunction with bend sensors (2400) mounted on 
the knee during physical therapy sessions as shown in FIG. 24a. The vibrou^ctUe unit notiiies 
the user when the knee is exercised appropriately and alerts the user if the knee is nexed turther 
than a safe limit prescribed by a doctor and thus improve recoven^ as is illustrated in FIG. 24b. 
Furthetmore. the vibrotactile units, in conjunction with other .sensors, may be used m any 
biofeedback application. 
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FIGS. 25a. 25b and 25c illustrate an approach for decoupling the amplitude and frequency 
components of the vibradons generated by an eccentric mass-based vibrotactilc unit. In this 
embodiment, the vibrotactile unit comprises a rotary electric motor f250l). a mass mounted 
eccentrically (2500). a sensor f2503) mounted on the shaft (2502) to determine the angular 
position of the shaft and a closed-loop control system. Any other conu-ol law may be used that 
achieves a single rotation of ihe shai't. One example is shown in FIG. 25a. The vertical axis of 
the graph represents a normalized current, the horizontal axis represents the rotation of the axis 
in radians. This corresponds to the following non-linear control law: 

/ = K (S>e>Tt) 

/ = -I, (7C > G > 2n-S) 

/ = 0. (-6 > e > 8) 

With the initial conditions set so that the velocity is zero and rotational position of the mass, 
9, (in radians) is equal to a small value. 5 . (FIG. 25b) sending current. A to the motor in this 
manner would cause the mass to accelerate for half of a full rotation, up to 9+5 (FIG 25c), 
and decelerate for the other half of the rotation coming to a stop between the -5 and +5 position 
in the ideal case. The actual position of the -5 and the +6 position may have to vary depending 
on the bandwidth of the control loop and the friction and damping of the system. The magnitude 
of vibration or impulse is set by the amplitude of the current, the frequency is set by repeating 
the above control ai the desired frequency. A simple feedback control loop (PID for example) 
could ensure the initial conditions arc correct before each pulse. The details of this are common 
knowledge to those skilled in the art. 

FIG. 26a is a perspective drawing and FIG. 26b is a side view of a vibrotactile unit with 
controllable eccentricity. A structure, such as a slip-disk (2602), is mounted on the shaft (2601 ) 
and is free to slide back and foah along the shaft. Tlie slip-disk is attached to a linkage (2605) 
which connects it to the eccentric mass (2604). A positioning device (2603) controls the posi- 
tion of the slip-disk on the shaft, which in turn alTecLs the position of the mass (via the linkage) 
and thus its eccentricity. FIG. 26c is an aJternaiive transmission method that can be used to 
control the eccentricity of the mass. In FIG. 26c, the transmission comprises element (2606). 
which may be a flexible membrane or fluid inside a hollow shai't (2601) that is connected to the 
eccentric mass (2604) at one end and the sliding slip-disk (2602) at the other. Again, controlling 
the position of the disk along the shaft using the positioning device (2603) affects the eccen- 
tricity of the mass. Element 2606 may also be a fluid and 2604 a hollow container. As the fluid 
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is force, .hrcugh .he ..he (260.> by ,he sUp-dis. (2602,. or by sc-e o.ber pressure generaung 
™eans, .he container (2604) is nued wich (he neid. .bus increasing ,he eiTecuve radius o, gyra- 
.ion of .he cen.r of mass of .he fluid. By increasmg .he radius of gy...,on. by whichever 
„,eans. i. .s possible ,o independen.ly conuol .he ampH.ude and frequency of vibra.ion of .he 

vibrotactile unit 

HG -1 provides an exemplary block diagram of .he componenus and func.ional rela.io„ship 
he.ween'.he component comprising .be vihrolacUe device when u.sed in an appUca.,on. 
Al.hou=h some component are shown ,n.errela«d wi.h a unidirecional arrow, arrows may 
be bidi^ecional .o provide bidirecional now of informauon. AddUional arrows may be added 
between blocks .o provde for communica.ion be.ween component. An applica..on may 
include presenting vibro.ac.ile sensa.ion .o a body par.of a user, where me vibro.ac.ile sensa- 
„on ,s associa.ed wi.h a virrual environmen. simulaUon .v,r.ual simulauon, and/or .he phys.ca. 
s.. of a body (physical simula.ion,. wh.ch may be .he user's body. .,r anorher person s body. 
One or more virn^al .simulaUons may co-exis. wi.b one or more physical simula.ions. and may 
be combined wi.h furrher .ypes of simulaUons .o yield a vibro.ac.ile ,«nsa.,on. 

The exemplary vir,ual simulation (2722) of FIG. 27 comprises a compurer (2706) wid, 
compu.erm„ni.or (2709). Toproduce .he vinual simulauon. .he compu.er.ypically generates. 

processes, executes or ntns a compu.er simula.ion (2705) which is .ypically in .he fon. of a 
compu.er software program. In the exemplary vir.ua, simula.ion. d,e compu.er produces a 
graphical display .,f a vir.ua, measured body par. on .be moni.or. where .he body pan .s shown 
.0 be a l,n=er.ip (2707, .,n a v.nual hand ,2708). The v.rrual s.mula.ion may .".erna, ly gcneme 
an .ntemai state with a variety of state variables which comprise a vtaual state s.gna, (.703 
provide to a signal processor (2700). Exemplary v.rtual state variables include posltton. veloc 
ity acceleration, mass, compliance, size, applying fo,.e or torque, composltton. temperature, 
moisture, smell, taste and other dynamical. s.ruc.ural. physical, eiecncal me.abolical moodal. 
cognitive, biological and chemical ptopenies of various poruons internal to. and on .he surtace 
of. a Virtual measured body pari. Srates Variables may also denote functions of .state vanables. 
such as conuict of various parts of die virtual hand, 

FIG 27 also provides an exemplary physical simulauon (2723) comprising a state sensor 
(27 18) a„d a physical measured body part (27 ,7), In this example, .he physical measured body 
part is depicted as a lingentp (27,7, on a physical hand (27,6), The state .sensor measures the 
phys-cal s.a.e (27,9) of .he pbys.cal measured body pan and produces a physica, state s.gna, 
P770) to provide to the stgnal processor (2700). The physica, state signal ,2720) is opuonally 
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provided to the computer (2706) and/or compuicr simulation (2705) oi a virtual simulation 
(2722). Exemplar\' physical stale variables include position, velocity, acceleration, mass, 
compliance, size, applying force or torque, composition, temperature, moisture, smell, taste and 
other dynamical, structural, physical, electrical, metabolical. moodal, cognitive, biological and 
chemical propenies of various portions internal to. and on the surface of. a physicaJ measured 
body part. States variables may also denote functions of state variables, such as contact of vari- 
ous pans of the physical hand. 

As shown in FIG. 27, for both the virtual simulation and the physical simulation, the signal 
processor (2700) receives a state signal and produces an activating signal (2704). For the 
virtual simulation, the state signal is the virtual state signal (2703); for the physical simulation, 
the state signal is the physical state signal (2720). When the application comprises both a 
viroial simulation and a physical simulation, both a virtual state signal and a physical state 
signal may be presented to the signal processor. 

The signal processor may employ a digital or analog computer (2701) to interpret one or 
more input state signals (e.g., a virtual or physical state signal) and produce a control signal 
(2721) which becomes the input signal to a driver (2702). Using the control signal, the driver 
produces the activating signal (2704). When the computer is absent from the signal processor, 
the driver determines the activating signal from the state signal or signals. Whether or not the 
computer is present in the signal processor, the activating signal is provided in a form for use 
by the mass-moving actuator (2710). For example, the driver may comprise a motion control 
module, an operational amplifier, a transistor, a lluidic valve, a pump, a governor, carburetor, 
and the like. In the case where the mass-moving actuator is an electric motor, the activating 
signal may be a voltage or current with sufficient electrical power or current drive to cause the 
motor to turn. 

In FIG. 27. the mass-moving actuator (2710) is shown to be an electric motor which turns a 
shaft (2712) and an eccentric mass (271 1). As the mass is rotated, the entire assembly of 2710. 
271 1 and 2712 vibrates, producing vibrations (27 13). Such vibrations are transmitted to a sens- 
ing body part of a u.ser who perceives a tactile sensation. In the figure, the sensing body part is 
exemplified as the fingenip (2715) of a hand (2714). 

An exemplary application which comprises a virtual simulation and a physical simulation is 
summarized as tbllows: 
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A fingertip of a physical hand corresponds to both the sensing body part (2715) and the 
physical measured body part (2717). An instrumented glove, optionally compnsmg a joml 
angle sensor and spatial posU.on sensor, produces a physical state s.gnal (2720) correspondmg 
to the posaion of the physical fingert.p. The fingertip position is provided via a w.re (e.g.. elec- 
trical or optical), computer bus or other electrical or optical connecting means to a computer 
(2706) canning a computer simulation (2705) in software. Ute fingeaip position >s often 
provided in the form of digital values, typically as joint angles and/or values corresponding to 
the six possible spatial degrees of freedom. The fingertip position may also be m the torm ot 
an analog voltage. 

Tte computer simulalion uses .he physical s,a,e signal (2720) corresponding .0 .he physical 
nngerrip posilion (27.9) .o simute .he posi.ion and nacion of a virtual hand (2708) and 
r,nger„p (2707). The compu.er simulation displays .he virtual hand on a computer mom.or 
,2709) in addi.ion .o displaying a second virrual object whose attributes may correspond to a 
second physical measured object, such as a block, ball, car interior, engineering pan, or other 
Object The computer monitor may be a desk-top monitor. head-moun«d monitor, projection 
monitor, holographic monitor, or any other compuier g=nera.=d display means. The second 
physical measu,ed objec. may also be a body par. of the user or a second user. 

When the user moves his hand, producing a movement of the virtual hand, the computer 
simulation detects a level of virtual comae, between the virtual ftngertip (2707, and the second 
virtual obiec. Tl,e computer simulation then produces a v.rtual state signal (2705, where one 
stau= variable denotes .he level te.g.. amoun. of force, of the v.rrual contac. of the v.r.ual finger- 
tip Tlte virrual stau; signal is transmitted .0 .he signal processor (2721) via a wire (e.g., elec- 
trical or op,ieal). compu.er bus or orher elecrical or optica, connecting means. The s.gnal 
processor may exist in U,e computer ,2706). in which case the virtual state signal is typically 
transmitted via the computer bus. When the signal processor exist.s ,n a separate enclosure ,rom 
the computer, the virtual state signal is typically transmitted via a wire. 

The signal processor may convert the state variable level of virtual comact into an activating 
signal voltage proporUonal to the level of virtual contact force using a digital-to-analog 
converter followed by an operational ampimer. The voltage is ptcsented to the mass-movrng 
acuator ,27.0, typically by a wire (e.g.. electrical or optical) or other electrical or opnca 
connecung means. The mass-moving ac.ua.or may be a variable speed elec.ric mo.or wh.ch 
spins ecceniric mass (2711) on its shaft (2712). The electric motor 'with ecccntr.c mas.s are 
housed in a plastic housing or casing which is affixed to .be dorsal portion of .he instrumented 
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glove surrounding the i'ingenip. which fincenip corresponds to both the physical measured 
body pan and the sensing body pan. The alTixing is typically done with straps, sewing, gluing 
and the like. As the eccentric mass rotates, the electric motor, mass, casing and sensing body 
pan all vibrate, typically at a common tVequcncy. Ideally, there is little vibrational attenuation 
between the mass and the sensing body part such that as the eccentric mass rotates, the electric 
motor, mass, casing and sensing body part all vibrate with the same amplitude. 

In the application just described, the user may perceive a cause-and-cffect relationship 
between motion of his fingertip and the level of vibration he feels. Thus, the position, compli- 
ance, masS; shape and other attributes of a vinual object may be detected by movement of the 
user*s fingertip, or by movement of the virtual object, inducing various vibrotactile responses. 
The vibrotactile device of the subject invention promotes a sensation of immersion in a vinual 
environment where the user is able to interact with virtual objects as if he were interacting with 
physical objects in a physical environment. 

Any publication or patent described in the specification is hereby included by reference as 
if completely set forth in the specification. 

While the invention has been described with reference to specific embodiments, the descrip- 
tion is illustrative of the invention and is not to be construed as limiting the invention. Thus, 
various modifications and amplifications may occur to those skilled in the art without departing 
from the true spirit and scope of the invention as defined by the appended claims. 
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CLAIMS 

What is claimed is: 

1 An apparatus for providing a tactile sensation to a sensing body pan in relation to a 
virtual state signal, said apparatus composing al least one vibrotactUe unit, wherein each unit 
comprises: 

a mass-moving actuator comprising a shaft and an eccentric mass mounted on said shaft, 
said mass-moving actuator rotating said shaft: and 

fastening means for holding said mass-moving actuator in relation to said sensing body pari 
for transmitting vibrations to said sensing body pan; 

wherem said apparatus further comprises a signal processor for interpreting said virtual state 
signal 10 produce an activating signal and transmitting said activating signal to said mass- 
moving actuator for activating said mass-moving actuator. 

2. An apparatus according to Claim 1 . wherein said fastening means comprises a casing 
containing said vibrotactilc unit. 

3. An apparatus according to Claim i. wherein said activating signal provides varying 
levels of activating said mass-moving actuator for varying the rotation of said shaft. 

4 An apparatus according to Claim 1 . wherein said mass-moving actuator is an electric 
motor and said apparatus comprises electrical connection means connecting said electric motor 
to said signal processor. 

5. An apparatus according to Claim 1. wherein said fastening means comprises means for 
fastening to a portion of a hand. 

6. An apparatus according to Claim 5. wherein said portion of a hand is the dorsal side of 
a finger. 

7. An apparams according to Claim 5. wherein said portion of a hand is the metacarpus. 

8. An apparatus according to Claim 1 . wherein said eccentric mass is pie-shaped. 

9. An apparatus according to Claim 1 . comprising a plurality of vibrotactilc units. 

10 An apparatus according to Claim 9. wherein said signal processor produces muluple 
activating signals for individually activating each vibrotactilc umt of said plurality of vibrotac- 
tilc units to produce a complex tactile sensation. 
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1 1. An apparatus for providing a tactile .sensation to a sensing body part in relation to a state 
ot a measured body part, said apparatus comprising at least one vihrocactile unit, wherein each 
unit comprises; 

a mass-moving actuator comprising a shaft and an eccentric mass mounted on said shaft, 
said mass-moving actuator rotating said shaft; and 

fastening means for holding said mass-moving actuator in relation to said sensing body part 
for transmitting vibrations to said sensing body pan; and 

wherein said apparatus further comprises; 

a state sensor for measuring the state of said measured body pan and generating a state 
signal: and 

a signaJ processor for receiving said state signal to produce an activating signal and trans- 
mitting said activating signal to said mass-moving actuator for activating said mass-moving 
actuator, 

12. An apparatus according to Claim 1 L wherein said fastening means comprises a casing 
containing said vibrotactile unit 

13. An apparatus according to Claim 1 L wherein said activating signal provides varying 
levels of activating said mass-moving actuator for varying the rotation of said shaft. 

14. An apparatus according to Claim 13, wherein said mass-moving actuator is a variable 
speed electric motor. 

1 5. An apparatus according to Claim 1 3. wherein said fastening means comprises means for 
fastening to a ponion of a hand. 

1 6. An apparatus according to Claim 1 5. wherein said ponion of a hand is the dorsal side of 
a finger. 

17. An apparatus according to Claim 15. wherein said portion of a hand is the metacarpus. 

18. An apparatus according to Claim 11, wherein said eccentric mass is pie-shaped. 

19. An apparatus according to Claim 11, comprising a plurality of vibrotactile units, 
wherein said signal processor produces multiple activating signals for individually activating 
each vibrotactile unit of said plurality of vibrotactile units to produce a complex tactile sensa- 
tion. 
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r^ioi,« n wherein said apparatus has a plurality ol" state 
'>0 An apparatus according to Claun 11. wherein sam 

sen'sors. each s>a. sensor for measuring >he su,e c, a d.ffercn. sa.d measureO body pan. 

. , An apparatus for providing a complex «.ile sensauon .0 a sensing body pan ,„ n=la.i„n 

• . „„ .,r i^iu nnc vibrotaciile unit, wherein each unit 
to a state signal, said apparatus compnsing at least one vioroia 

comprises: 

■ ■ , ohofi infi in eccentric mass mounted on said shal't. 
a mass-moving actuator compnsing a shall and an ecceninc m 

said mass-moving actuator rotating said shaft; and 

fastening mear.s for holding said mass-moving actuator in relation to said sensing body part 
for transmitting vibrations to said sensing body pan: 

wherein said apparatus further comprises a signal processor for ^terpreting said state signal 
to produce an activating signal and transmitting said activating signal to said mass-moving 
actuator for activating said mass-moving actuator. 

,^ n\.\m ^1 comorisine a plurality of vibroiactUe units. 
22 An apparatus according to Claim ^1. compnsing a y j 

Wherein sard signa, processor produces nruiiipie acvai., signals for individually acuvai^g 
each vibroucUle uni. of said plurali.y of vibrotactile uniu ,0 produce sa.d complex .acule 

sensation. 

.3 A method for providing uoUe scnsarion ro a sensing body part in relation to a sute 

■u.^to/^t;i*> nnn wherein said vibroiactilc unii 
signal, employing an apparatus composing a v.brotactile unit, wherein 

comprises: 

n .hnfi nnd an eccentric mass mounted on said shall, 
a mass-movine actuator compnsing a shaft and an ecceninc 

said mass-moving actuator rotating said shaft: said method comprising: 
mounting said vibrotaciile unit on a sensing body part; 
interpreting said state signal lo produce an activaung signal: and 

transmitting said acUvating signal to said mass-movmg actuator for varying the rotation of 
said shaft to provide a tactile sensation to said sensing body part. 

24. A memod according to Claim 23. wherein said mounting comprises mounting each of 
a plurality of vibrotaciile units on different said sensing body pans: and 

said transmuting comprises transmitting individu^ activating signals to each of s^d vibro- 
taciile units to produce a complex tactile sensauon. 



28 



wo 97/20305 



PCT/US96/I9209 



1 / 20 



100 



105 





103 



FIG. lA 



FIG. IB 



200 204 



201 




^02 

FIG. 2A 



203 




FIG. 2B 



SUBSTITUTE SHEET fRULE 261 



wo 97/20305 



2/20 



PCT/US96/19209 




FIG. 3 



400 




FIG. 4 



QlincXiTMTP CSMPPT f Ql II P OR\ 



wo 97/20305 



PCT/US96/19209 



3/ 20 





FIG. 6 



CI mc*ri-rf i*rc= cuiccx /Dili C 



wo 97/20305 



PCTA.'S96/19209 



4/20 




FIG. 7 

902 




801 



FIG. 9 FIG. 8 



wo 97/20305 



PCT/L'S96/19209 



5/20 




FIG. lOA FIG. 10 B 



wo 97/20305 PCT/US96/19209 



6/20 



!I03 




FIG. IIA 




1102 



FIG. MB 



1201 



1200 




1202 



FIG. I2A 



201 



1200 




1203 

FIG. I2B 



CimCTITIITC CUCC-r/Dlll C nc\ 



wo 97/20305 



PCT/US96/I9209 



7/20 




FIG. 13 



1403 




SUBSTITUTE SHEET (RULE 26) 



wo 97/20305 



8 / 20 



PCT/US96/I9209 




FIG. I6A 



W= W| 

FIG. I6B 



602 




FIG. I6C 




FIG. I6D 



wo 97/20305 



PCT/US96/19209 



9/20 



CD 
O 



o 





SUBSTITUTE SHEET (RULE 26) 



wo 97/20305 



PCT/US96/19209 




CIIRQTITIITP QUPPT mill P 



wo 97/20305 



PCT/US96/19209 



12 / 20 




wo 97/20305 



PCT/US96/19209 



13 / 20 




SUBSTITUTE SHEET fRIII E 1>M 



wo 97/20305 



PCT/US96/19209 




wo 97/20305 



PCTA;S96/1 9209 



15/20 




VIBROTACTILE 
UNIT 
(2100) 



SENSING 
GLOVE. 
(2101) 



FIG. 2IA 




VIBROTACTILE 
UNIT 
(2100) 



SENSING 
GLOVE 

(2101) FIG. 21 B 



PCT/LS96/19209 

WO 97/20305 

16/20 




FIG. 22 



wo 97/20305 



PCT/US96/19209 



17/ 20 




FIG. 24 A 



PCT/US96/19209 



18/ 20 















2-Tr 


3Tr 


4 TC 



FIG. 25A 




FIG. 25B 




FIG. 25C 



wo 97/20305 



PCT/US96/I9209 



19/20 



2600 



2604 



2605 




2602 

FIG. 26A 



n 



^2604 
2605 




2600 



2601 / P_2603 
2602 ^JL 



FIG. 26B 




2600 



2602-^ [H!] 

2603 



FIG. 26C 



wo 97/20305 



PCT/US96/19209 



20/20 




INTERNATIONAI. SEAJICH REPORT 



Intemaiional application No. 
PCT/US96/ 19209 



A. CLASSIRCATION OF SUBJECT MATTER 

IPCf6) :G09G 5/00 
US CL :345/l56.158; 414/2,5 
According to International Patent Classification (IPC) or to both national claisifi cation and IPC 



B. RELDS SEARCHED 



Minimum documentation searched (classiftcation system followed by clajsi/ication symbols) 
U.S. : 345/156,158; 414/2,5 



Documentation searched other than minimum documentation to the extent that such documents arc included in the fields searched 



Electronic data base consulted during the international search (name of daU base and, where practicable, search terms used) 



I C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



us 5.184,319 A (KRAMER) 02 February 1993, col. 3, line 
25 to col. 10, line 35. 

US 4,731,603 A (MCRAE et al) 15 March 1988, col. 8, line 
64 to col. 9, line 34 and Fig. 6. 



1-24 



1-24 



1 1 I Further documenu are listed in the 



continuation of Box C. 



□ 



Sec patent family annex. 



•A' 
•L- 

-p. 




.y. 




rof tfae mtnc pm nr fMnity 



Date of the actual completion of the international aearch 
19 FEBRUARY 1997 



Dale of mailing of the international search report 



1 9 MAR 1997 



Name and mailing axidress of the ISAAJS 
CoTTnnif>k>ocr of Patects and Trademarks 
Box PCX 

Wwhinftoa, D.C. 20231 
I Pacaimile No. (703) 305-3230 



Ponn PCT/lSA/2ia (scoond sbeetXJuly 1992)* 



Autbomed ofKdfer ^ 

RECilNA UASGA^y 
Telephone No. r703) 305-4719 



